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Executive  Summary 

In  spring  1999,  the  U.  S.  Coast  Guard  aids-to-navigation  program  (G-OPN)  determined  that 
testing  and  evaluation  was  required  on  various  aid  to  navigation  software  tools  used  for 
positioning  floating  and  fixed  short  range  aids.  As  part  of  the  Coast  Guard’s  migration  to 
standard  workstation  III  (Windows  NT  environment),  and  as  a  result  of  upgrades  in  the 
electronic  chart  navigation  software  of  the  new  seagoing  and  coastal  buoy  tenders,  the  program 
expected  to  have  three  different  software  applications  in  use  over  the  next  several  years 
Questions  arose  regarding  the  accuracy  and  consistency  between  these  applications  in 
positioning  aids.  The  program  asked  the  USCG  R&D  Center  to  test  and  evaluate  the  existing 
systm,  AAPS  3.4,  its  successor  ATONIS/AAPS  4.0,  and  the  aids-to-navigation  enhancement  to 
the  buoy  tender’s  electronic  chart  navigation  system,  ECPINS/ATON  1.71. 


A  proposal  and  test  plan  were  developed  to  determine  the  accuracy  of  range  and  bearing 
mnctions  used  to  position  floating  aids  to  navigation.  These  calculations  are  the  key  elements  in 
determining  when  an  aid  is  on  station.  The  R«feD  Center  conducted  the  tests  by  comparing  the 
^o^ams  outputs  to  independently  calculated  outputs  developed  using  algorithms  obtained  from 
e  National  Geodetic  Survey.  Test  points  at  various  places  around  the  world  were  generated  to 
test  all  possible  combinations  of  quadrants  and  hemispheres.  AAPS  3.4  and  ATONIS/AAPS  4.0 
were  tested  at  the  R&D  Center  with  assistance  from  G-OPN  for  operation  and  set-up  of 
ATONIS/AAPS  4.0.  ECPINS/ATON  1.71  was  tested  at  the  USCG  Command  and  Control 
Engmeenng  Center  in  Portsmouth,  Virginia,  in  September,  1999,  with  the  help  of  the 
WLB/WLM  Land  Based  Support  Facility.  ECPINS/ATON  1.73  was  tested  by  the  WLBAVLM 
Land  Based  Support  Facility  in  December,  1999,  to  determine  if  this  new  revision  corrects  the 
discrepancies  found  in  version  1.71.  Both  sets  of  data  are  included  in  this  report 


In  order  to  judge  the  impact  of  any  calculation  differences  found;  we  developed  an  error  budget 
w  positioning  that  includes  all  of  the  relevant  error  sources  involved  in  the  positioning  process 
The  range  and  bearing  calculations  (subject  of  this  test),  data  precision,  positioning  system 
accuracy  (DGPS),  position  translation  accuracy,  and  vessel  maneuvering  accuracy  were  included 
in  the  error  budget.  When  examined  in  this  systematic  fashion,  the  driving  factors  are  the  DGPS 
accuracy  and  the  vessel’s  maneuvering  accuracy.  At  the  accuracy  levels  found  in  the  testing,  the 
positioning  programs  themselves  are  virtually  interchangeable  with  no  effect  on  the  positioning 
performance.  The  specific  results  were  as  follows:  both  AAPS  3.4  and  ATONIS/AAPS  4  0 
applications  were  found  to  be  accurate  to  within  0.5  inches  in  range  and  within  .01  degrees  in 
beanng  to  the  calculated  truth  measurements.  ECPINS/ATON  1.73  was  found  to  be  accurate 
within  five  inches  in  range  and  within  .01  degrees  in  bearing  to  the  calculated  truth 
measurements.  The  errors  in  version  1.71  were  clearly  corrected.  All  three  positioning 
programs  can  now  effectively  be  used  interchangeably  and  achieve  identical  results. 
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List  of  Acronyms 


AAPS 

Automated  AtoN  Positioning  System 

ANT 

Aids  to  Navigation  Team 

APR 

Aid  Positioning  Report 

ATONIS 

Aids  to  Navigation  Information  System 

C2CEN 

Command  and  Control  Engineering  Center 

DGPS 

Differential  Global  Positioning  System 

DPS 

Dynamic  Positioning  System 

ECPINS 

Electronic  Chart  Precision  Integrated  Navigation  System 

EECEN 

Electronic  Engineering  Center 

GPS 

Global  Positioning  System 

LBSF 

Land  Based  Support  Facility 

MEA 

Mission  Essential  Application 

NGS 

National  Geodetic  Survey 

NMEA 

National  Marine  Electronics  Association 

OOD 

Officer  Of  the  Deck 

OSC 

Operations  Systems  Center 

OSL 

Offshore  Systems  Limited 

SWIII 

Standard  Workstation  III 

WEB 

Seagoing  buoy  tender 

WLM 

Coastal  buoy  tender 

Introduction 

Several  AtoN  buoy  positioning  systems  are  expected  to  be  in  use  in  the  Coast  Guard  in  1999- 
2000.  In  this  time  frame,  AtoN  operations  will  be  transitioning  from  the  AAPS  3.4  to  the 
ATONIS/AAPS  4.0  (ANTs  and  older  cutters)  or  the  ECPINS/ATON  (WLM  (keeper  class), 
WLB  (Juniper  class)).  Testing  was  required  to  determine  that  all  of  these  applications  properly 
position  aids  to  navigation  by  delivering  consistent  and  accurate  results. 

AAPS  3.4  -  Originally  written  by  R«&D  Center  as  the  final  deliverable  from  the  AAPS  R&D 
project,  delivered  for  fleet  use  in  1991,  maintained  by  EECEN  and  later  OSC.  Tested  in  June 
1999 

ATONIS/AAPS  4.0  (MEA)  -  The  combination  of  the  ATONIS  database  and  the  AAPS 
positioning  function  being  implemented  under  the  SWIII MEA  conversion  contract  with  Anteon, 
Inc.  under  G-OPN  supervision.  Tested  in  July  1999. 

ECPINS/AtoN  -  Created  by  Offshore  Systems  Limited  under  contract  to  G-OCU  to  allow  the 
new  WLB/WLM  fleet  to  use  the  ECPINS  system  for  AtoN  positioning.  Tested  in  September 
1999  by  RDC  and  in  December  1999  by  C2Cen. 

Objective 

Conduct  a  test  of  each  of  the  three  AtoN  positioning  support  systems  expected  to  in  use  by  the 
Coast  Guard  in  1999-2000.  Tliis  test  was  designed  to  treat  each  system  as  a  "black  box,"  with  no 
specific  knowledge  of  its  internal  workings.  Calculated  positions  in  the  form  of  NMEA  0183 
GPS  receiver  output  were  input  to  each  system  and  compared  to  the  known  result  as  calculated 
using  algorithms  developed  by  the  National  Geodetic  Survey.  Any  differences  are  documented 
and  anal>^ed  for  impact  on  the  AtoN  mission.  Impact  is  evaluated  through  the  use  of  an  error 
budget  that  accounts  for  all  of  the  various  errors  involved  in  positioning  aids  with  DGPS.  This 
effort  has  also  produced  a  standard  test  that  can  be  executed  to  validate  revisions  to  these  or 
other  future  positioning  systems. 

Benefit 

Proven  accuracy  and  consistency  of  the  Coast  Guard’s  AtoN  positioning  tools  will  ensure  that 
aids  are  positioned  on  station  when  any  of  the  available  tools  are  used.  This  will  give  the  Coast 
Guard  a  solid  technical  basis  to  defend  its  positioning  procedures  during  marine  investigations. 

Error  budget 

As  part  of  this  effort  to  measure  and  evaluate  the  accuracy  and  differences  in  various  AtoN 
positioning  tools  we  felt  it  was  important  to  put  the  results  in  context  with  the  rest  of  the 
positioning  system.  This  is  done  through  the  determination  of  an  error  budget  that  considers  the 
various  error  sources  in  placing  an  aid  on  station.  This  error  budget  considers  everything  from 
the  standpoint  of  the  ship  positioning  to  the  point  that  the  decision  is  made  to  set  the  buoy.  It 
does  not  consider  other  factors  such  as  what  happens  to  the  buoy  sinker  when  it  is  released  from 
the  chain  stopper,  i.e.  whether  it  falls  straight  down. 
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Range  and  bearing  accuracy 

The  accuracy  of  each  system’s  ability  to  calculate  range  and  bearing  from  the  most  probable 
position  (MPP)  to  the  assigned  position  (AP)  is  the  first  element  in  this  error  budget  and  the 
subject  of  this  test.  This  element  of  the  error  budget  was  unknown  until  this  test. 


NMEA  0183  precision 

While  the  precision  of  positions  in  the  NMEA  0183  GGA  format  is  not  explicitly  defined,  the 
maximum  overall  length  of  the  GGA  message  practically  limits  it  to  a  reasonable  number.  The 
Trimble  NT200CG ,  Leica  9212  and  9412  receivers  use  four  digits  of  precision  i.e.  die  least 
significant  digit  is  .0001  minutes  of  Latitude  or  Longitude  which  is  0.2  yards  in  Latitude. 


DGPS  accuracy 

DGPS  accuracy  is  directly  dependent  on  the  precision  and  accuracy  of  the  GPS  measurements 
and  therefore  is  a  function  of  the  type  of  GPS  receiver  in  use.  Trimble  NT200CG  is  nominally  5 
yards  95  percent,  Leica  9212  (early  JUNIPER  and  KEEPER  class  tenders)  has  been  measured  to 
2  yards  95  percent,  Leica  9412  (later  JUNIPER  and  KEEPER  class  tenders)  would  be  expected 
to  perform  at  close  to  1  yard  95%  (based  on  manufacturer’s  data)  and  the  new  WLBAVLM 
Starlink  Invicta  210M  would  be  expected  to  perform  at  2-4  yards  95%. 


Translation  error 

This  value  is  an  approximation  of  a  typical  error  involved  in  translating  the  GPS  antenna  position 
down  to  the  buoy  deck  and  over  to  the  chain  stopper.  It  was  derived  as  follows:  assume  one 
degree  of  gyro  error,  take  the  sin  of  this  angle  and  multiplying  by  a  typical  distance  from  the 
GPS  to  the  chain  stopper,  30  yards,  to  yield  0.5  yards. 


Maneuvering  accuracy 

Maneuvering  accuracy  is  the  biggest  variable  in  this  error  budget.  Environmental  factors  such  as 
wind  and  current  play  a  large  role  in  the  accuracy  of  both  manual  and  automatic  (DPS) 
positioning.  This  is  essentially  an  estimate  of  how  precisely  the  operators  or  dynamic 
positioning  system  (DPS)  can  maneuver  the  ship  to  where  the  positioning  program  shows  the 
^signed  position.  JUNPIER  class  DPS  was  measured  as  performing  at  10  Meters  95  percent  in 
difficult  conditions,  but  typical  results  are  within  5yds  (QMl  Kvistad  USCGC  JUNPER). 
KEEPER  class  DPS  was  measured  closer  to  5  meters  95  percent  in  similar  difficult  conditions. 
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Interviews  with  field  operators  (CWO  John  Haley,  CO  of  USCGC  KATHERINE  WALKER) 
show  typical  automatic  and  manual  WLM  performance  to  be  closer  to  2  meters  95  percent. 

Total  positioning  error 

Total  positioning  error  is  the  square  root  of  the  sum  of  the  squares  of  each  element  in  the  error 
budget.  This  analysis  shows  that  AtoN  positioning  errors  are  dominated  by  the  two  most 
significant  error  sources,  positioning  errors  from  DGPS  and  maneuvering  errors  by  the  automatic 
systems  or  the  vessel  operators.  Other  sources  of  error  such  as  the  algorithms  used  in  positioning 
software  or  vessel  offsets  are  insignificant  in  the  final  outcome. 


Test  Development 

The  tests  to  evaluate  the  positioning  capabilities  were  created  to  thoroughly  evaluate  range  and 
bearing  functions  for  every  possible  trigonometric  case.  This  section  is  divided  into  test  concept, 
preparation  and  procedure. 


Test  concept 

R&D  Center  created  specific  scenarios 
to  test  the  positioning  function  of  these 
systems  to  validate  the  algorithms  and 
methods  implemented.  The  test 
scenarios  included  testing  in  northern, 
southern,  eastern,  and  western 
hemispheres,  and  in  all  four  quadrants 
using  a  variety  of  test  points.  These 
test  points  and  the  actual  range  and 
bearing  to  their  associated  assigned 
position  was  determined  using  software  algorithms  from  National  Geodetic  Survey.  These  test 
points  were  created  as  files  of  NMEA-0183  data  that  is  "played"  into  each  system  to  be 
indistinguishable  from  its  normal  DGPS  input.  The  antenna  and  buoyport  shipboard  offsets  and 
excursion  functions  will  also  be  tested  similarly  for  geometric  accuracy. 
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Test  Preparation 

To  prepare  for  the  testing  of  these  systems  there  were  several  tasks  to  be  performed.  First  were  to 
layout  the  Assigned  Position  and  test  points  in  MS  Excel.  AP  was  chosen  to  be  representative  of 
an  area  where  the  Coast  Guard  works  aids  to  navigation.  Test  point  alpha  was  in  North  latitude 
and  West  Longitude,  Bravo  was  North  and  East,  Charlie  was  South  and  West  and  Delta  was 
South  and  East.  Eight  points  of  range  and  bearing  were  randomly  chosen  about  each  imaginary 
AP.  The  NGS  derived  routines  were  used  to  determine  the  latitude  and  longitude  of  each  of 
these  eight  points  about  each  AP.  These  eight  positions  then  had  to  be  turned  into  input  for  the 
positioning  programs.  The  latitudes  and  longitudes  were  truncated  to  the  precision  of  the  NMEA 
0183  data  (0.0001  min).  The  "True"  range  and  bearing  was  then  calculated  using  these  truncated 
values  to  obtain  a  number  to  compare  to  the  positioning  program  output.  This  process  was  laid 
out  in  the  following  spreadsheet. 
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This  extra  step  of  controlling  the  precision  of  the  numbers  was  crucial  to  getting  accurate  and 
consistent  results  from  these  tests.  At  this  point  we  had  the  assigned  positions  to  input  into  AAPS 
3.4,  ATONIS/AAPS  4.0  and  ECPINS/ATON-DB  respectively.  We  now  needed  a  way  to  input 
the  simulated  vessel  positions  at  the  eight  points  around  each  AP. 

To  do  this  we  created  simulated  DGPS  output  for  input  into  AAPS  3.4  and  ATONIS/AAPS  4.0. 
NMEA  01 83  data  was  recorded  from  a  Trimble  NT200CG  DGPS  receiver.  This  one  data  file 
was  then  manipulated  by  changing  the  latitude  and  longitude  of  the  position  in  the  SGPGGA 
message  to  correspond  to  the  NMEA  lat  input  and  NMEA  Ion  input  values  in  the  example 
spreadsheet.  This  manipulation  was  done  using  a  program  that  could  reconstruct  the  proper 
check  sum  value  for  the  SGPGGA  message.  Four  test  points  each  yielded  eight  files  of  test  data, 
one  for  each  test  case  for  a  total  of  32  test  files.  These  files  of  data  were  then  "played"  into  the 
two  AAPS  programs  using  another  program  as  if  the  data  were  coming  from  the  DGPS  in  real 
time.  For  ECPINS/ATON  we  used  the  Offshore  Systems  NVES  simulator  to  input  the  positions 
at  the  test  points.  Each  Aid  Positioning  Report  was  carefully  checked  to  ensure  that  there  were 
no  data  entry  errors. 

Test  Procedure 

Test  procedures  were  developed  for  each  of  the  systems  under  test.  The  tests  were  conducted  in 
three  parts,  range  and  bearing  to  AP,  antenna  offsets,  and  excursion.  The  tests  were  separated  so 
that  any  error  in  one  of  these  would  not  effect  the  others. 

AAPS  3.4 

AP  for  Alpha,  Bravo,  Charlie  and  Delta  were  entered  into  AAPS  3.4  as  new  aids.  The  system 
was  configured  to  position  at  Short  Stay  with  no  antenna  or  buoy  port  offsets.  AP  Alpha  was 
selected  and  all  eight  test  cases  were  played  into  the  system.  The  Found  and  Set  functions  were 
exercised  and  an  Aid  Position  Report  (APR)  was  printed  for  each  test  case.  The  same  was  done 
for  test  points  Bravo,  Charlie  and  Delta.  To  test  the  antenna  offset  calculations  test  case  Alpha  1 
was  used  to  provide  data  input.  The  Alpha  1  position  was  also  input  as  the  AP.  Various 
headings  were  manually  input  to  AAPS  3.4  and  the  results  were  recorded  on  more  APRs. 

Offsets  of  17  yards  and  917  yards  were  used  to  test  for  any  sensitivity  to  distance.  Excursion 
was  similarly  tested  and  confirmed  through  inspection. 
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ATONIS/AAPS  4.0 

AP  for  Alpha,  Bravo,  Charlie  and  Delta  were  entered  into  ATONIS/AAPS  4.0  as  new  aids.  The 
system  was  configured  to  position  at  Short  Stay  with  no  antenna  or  buoy  port  offsets.  AP  Alpha 
was  selected  and  all  eight  test  cases  were  played  into  the  system.  The  Found  and  Set  functions 
were  exercised  and  an  Aid  Position  Report  (APR)  was  printed  for  each  test  case.  The  same  was 
done  for  test  points  Bravo,  Charlie  and  Delta.  To  test  the  antenna  offset  calculations  test  case 
Alpha  1  was  used  to  provide  data  input.  The  Alpha  1  position  was  also  input  as  the  AP.  Various 
headings  were  manually  input  to  the  AAPS  4.0  routine  and  the  results  were  recorded  on  more 
APRs.  Offsets  of  1 7  yards  and  917  yards  were  used  to  test  for  any  sensitivity  to  distance. 
Excursion  was  similarly  tested  and  confirmed  through  inspection. 

ECPINS/ATON-DB 

AP  for  Alpha,  Bravo,  Charlie  and  Delta  were  entered  into  ATON-Database  as  new  aids.  The 
ECPINS  system  was  configured  to  position  at  Short  Stay  with  no  antenna  or  buoy  port  offsets. 
AP  Alpha  was  selected  and  all  eight  test  cases  were  manually  entered  into  NVES.  The  Found 
and  Set  functions  were  exercised  and  an  Aid  Position  Report  (APR)  was  saved  and  printed  for 
each  test  case.  The  same  was  done  for  test  points  Bravo,  Charlie  and  Delta.  To  test  the  antenna 
offset  calculations  test  case  Alpha  1  was  used  to  provide  data  input.  The  Alpha  1  position  was 
also  input  as  the  AP.  Various  headings  were  manually  input  to  the  ECPINS  and  the  results  were 
recorded  on  more  APRs.  Offsets  of  17  yards  and  317  yards  were  used  to  test  for  any  sensitivity 
to  distance.  317  yards  was  used  instead  of  the  917  yards  used  in  AAPS  because  917  yards  did 
not  work  in  ECPINS.  It  accepted  the  value  but  produced  results  that  were  clearly  in  error.  Both 
317  and  917  yards  far  exceed  any  realistic  value  for  Coast  Guard  ships.  Excursion  was  tested  at 
various  angles,  again  using  the  Alpha  1  AP.  ECPINS/ATON  1.73  was  tested  later  by  C2Cen 
WLB/WLM  Land  Based  Support  Facility. 

Test  Results 

Range  and  bearing  to  AP  data 

Range  and  bearing  are  crucial  data  for  positioning  aids-to-navigation.  They  are  used  for 
maneuvering  by  manual  and  automatic  means  and  to  determine  when  an  aid  is  on  station.  It  is 
very  important  that  AtoN  positioning  programs  obtain  equivalent  results  for  range  and  bearing.  It 
would  not  be  desirable  for  one  application  to  find  an  aid  on  station  and  another  finds  it  off 
station.  Test  results  for  each  of  the  four  test  points  are  presented  on  the  following  two  pages  in 
the  form  of  spreadsheets. 

AAPS  3.4  and  ATONIS/AAPS  4.0  obtained  equal  results  that  are  consistent  with  the  truth 
calculations  to  the  limits  of  round  off  error.  AAPS  3.4  rounded  bearings  off  to  0.01  degrees  and 
range  to  0.01  yards.  ATONIS/AAPS  4.0  rounded  bearings  off  to  0.1  degrees  and  range  to  0.01 
yards.  This  difference  in  bearing  round  off  represents  the  only  difference  in  the  results  between 
these  two  systems  and  truth.  This  consistency  is  not  surprising  as  AAPS  3.4  was  built  using  the 
same  NGS  algorithms  and  ATONIS/AAPS  4.0  is  intended  to  be  the  fimctional  equivalent  of 
AAPS  3.4.  As  the  range  or  distance  to  AP  is  the  determining  value  for  ON/OFF  station 
calculations  further  statistical  analysis  was  done  to  determine  the  standard  deviation  to  contribute 
to  the  positioning  error  budget.  The  standard  deviation  for  both  AAPS  3.4  and  4.0  was  0.008 
yards,  about  1/4  of  an  inch. 
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"ECPINS  1.73" 
Ranae  Bearina 

100.02  30.04 

75.09  58.93 

60.05  110.05 
20.00  156.68 
87.04  181.95 
300.25  241.01 
640.61  294.00 
30.95  344.80 

"ECPINS  1.71" 
Ranae  Bearina 

100.02  30.72 

75.09  59.61 

60.05  110.73 

20.00  157.36 

87.04  181.28 

300.25  240.34 

640.61  293.33 

30.95  344.13 

"AAPS4.0" 
Range _ Bearing 

99.93  30.00 

75.02  58.90 

59.99  110.00 

19.98  156.70 

86.95  182.00 

299.98  241.00 

640.03  294.00 

30.92  344.80 

"AAPS3.4" 
Ranae  Bearina 

99.93  30.04 

75.02  58.93 

59.99  110.05 

19.98  156.68 

86.95  181.95 

299.98  241.01 
640.03  294.00 

30.92  344.80 

"True" 

Ranae  Bearina 

99.929  30.041 

75.025  58.933 

59.990  110.051 
19.982  156.682 
86.959  181.955 
299.979  241.010 
640.029  294.001 
30.925  344.802 

NMEA  Lon  InoL 
Lon  1  Lon  Min 

144  0.0253 

144  0.0325 

144  0.0285 

144  0.0040 

143  59.9985 
143  59.8673 
143  59.7043 
143  59.9959 

NMEA  Lat  Inou 
Lat  [  Lat  Min 

13  0.0429 

13  0.0192 

12  59.9898 
12  59.9909 
12  59.9569 

12  59.9279 

13  0.1291 

13  0.0148 

6 


Test  Point  CHARLIE.  AP  =  60  00’  00.000"  S.  087  00’  00,000"  W 


"ECPINS  1 .73" 
Ranae  Bearina 

99.90  30.05 

74.94  59.03 

59.94  110.00 

20.06  157.03 

86.93  182.01 

299.87  241.01 

639.71  294.01 

30.90  344.94 

"ECPINS  1.71" 
Ranae  Bearina 

99.90  30.05 

74.94  59.03 

59.94  110.00 

20.06  157.03 

86.93  182.01 

299.87  241.01 

639.71  294.00 

30.90  344.94 

"AAPS  4.0" 
Ranae  Bearina 

99.94  30.00 

74.97  59.00 

59.96  110.00 

20.07  157.00 

86.97  182.00 

299.99  241.00 

640.01  294.00 

30.91  344.90 

ICCOOCOt-i-OCO 

c 

OOOOOOOO) 

.  ‘kl. 

^  cd 

coioi-inoo^o)^ 

T-  T-  1-  (N  CVJ  CO 

CO 

0) 

0- 

^NCDh-f^CD-r-'i- 

<  s 

030>0)00)0300> 

<  c 

cjjTrcncDcdcjicDCD 

o>r-inc\jcocy)'d-co 

GC 

C\J  CD 

h-cDcvjcO"r-h-0)in 

'^<MOC0t-O(3)C0 

OOOOOOC3)C3> 

cc 

dcjidr^cur-coTf 

-  <D 

COlOr-lOCOrta^ 

0)  CO 

1-  ^  T-  CM  CVJ  CO 

13 

1 

OOC3>C\JONNCOTt 

r  o 

COCDCDNCDCDCD-»- 

o 

03030)0030>0303 

c 

CT>TfCJ>dCDCJ)CT)d 

vu 

C33l^inCVJCOC33COCO 

a. 

CVJ  CO 

-j 

o 

(OOOC£>COOO(X}C7> 

OCOtJ-CMCOCOtTN 

i  C 

LOCO^<330LOh-0 

c  S 

C3)C3>Cy)C7)0CMU30 

o  ‘f 

CT>  d  d  d  d  d  d  d 

“!  o 

m  m  lo  Lo 

<  -j 

c 

cDCDcocoi^r^r^K 

OOOOCX)CX)OOOOCX)CX3 

z:  _j 

D 

"M-0'»“t“COCOCX)CO 

Q 

I^i-OCDCMt-t-LO 

C  c 

locO'i-O'^Kr^oo 

cncDOOoococj) 

cd  ^ 

dddddddd 

cd 

in  LO  LO  in 

LLl  i-i 

030)00000)03 

^  CO 

mincDcocDcomin 

Z  _J 

o 

CD 

N. 

in  00 

00 

CM 

o 

o 

CO 

03 

CJ3 

o 

CD 

CD 

o 

o 

T~ 

d 

a6 

o 

CD 

1— 

in 

*  .  Cd 

CVJ 

in 

T“ 

in 

00 

CD 

T** 

CM 

CM 

CO 

CO  “ 

Z 

CO 

CO 

CM 

00 

00 

00 

?r  ^ 
o  2 

o 

o 

C33 

CD 

CD 

00 

00 

o 

d 

in 

d 

d 

CD 

d 

d 

T“ 

LU  CO 

o 

in 

T“ 

00 

CD 

CO 

CO 

=  CC 

CM 

CD 

O 

=  c 

00 

o 

T- 

O 

CM 

CO 

00 

00 

00 

00 

00 

00 

CD 

d 

00 

d 

CD 

T“ 

d 

CO 

5 

CM 

in 

o 

in 

00 

CD 

1-  CD 

T— 

T— 

CM 

CM 

CO 

co“ 

z 

CO 

r- 

CO 

CM 

00 

00 

00 

E  § 

O  c 

o 

d 

o 

in 

CD 

d 

CD 

d 

CD 

CD 

00 

d 

00 

d 

q 

T— 

UJ  A 

=  DC 

o 

N 

in 

00 

CD 

CM 

CO 

CD 

CO 

D 

C 

o 

o 

o 

o 

O 

o 

o 

o 

o 

o 

o 

o 

O 

o 

o 

-  'C 

d 

d 

d 

cvi 

in 

o  cd 

CO 

in 

T“ 

in 

00 

CD 

^  CD 

T” 

CM 

CM 

CO 

^  CD 
CO 

0- 

in 

C33 

CD 

CO 

rt 

CD 

00 

LJJ 

s 

o 

o 

CD 

CD 

CD 

CD 

O 

o 

<  c 

d 

in 

CD 

d 

CC) 

CD 

d 

b 

o 

o 

=  L- 

OJ 

DC 

o 

in 

00 

CD 

CM 

CD 

CO 

CD 

In 

00 

00 

CM 

CD 

o 

o 

o 

c 

C33 

C33 

o 

CD 

CD 

O 

CD 

o 

~  *CI 

d 

CD 

d 

CD 

CO 

in 

CD 

CM 

in 

T- 

in 

00 

CD 

o 

o 

CO  ^ 
CO 

T“ 

T“ 

CM 

CM 

CO 

o 

0. 

in 

C33 

CD 

CO 

CD 

00 

1^ 

s 

o 

o 

CD 

03 

CD 

CD 

O 

q 

T“ 

S  c 

d 

in 

d 

d 

CC) 

d 

d 

T“ 

CO 

DC 

o 

in 

T“ 

00 

CD 

CO 

CO 

'T* 

CM 

CD 

O 

m 

T" 

"co" 

Id 

CD 

in 

1^ 

s 

00 

CD 

CD 

o 

03 

03 

CD 

CD 

q 

q 

q 

O 

d 

00 

d 

CD 

T~ 

CO 

in 

O 

-  0) 

CM 

in 

in 

00 

CD 

Tt 

d 

1  0)  CD 
D 

T— 

T— 

T— 

CM 

CM 

CO 

o 

if  © 

in 

CO 

CD 

CO 

CO 

CD 

r-. 

in 

03 

00 

CO 

in 

CO 

00 

o 

D 

o 

o 

CD 

CD 

CD 

CD 

o 

q 

o 

i  © 

DC 

d 

in 

d 

d 

CD 

d 

d 

T— 

o 

o 

1^ 

in 

T“ 

00 

CD 

CM 

CO 

11 

"5 

o 

"c^ 

“oT 

In" 

h- 

o 

Q 

in 

CM 

00 

CO 

00 

00 

CD 

c  c 

CM 

CO 

CM 

o 

CD 

CD 

o 

CD 

0- 

c  is 

o 

o 

o 

o 

CD 

00 

h- 

CD 

< 

d 

d 

d 

d 

d 

d 

d 

d 

s  <= 

o 

in 

in 

in 

LO 

< 

<  -■ 

H 

UJ  •- 

o 

o 

o 

o 

CD 

CD 

CD 

CD 

_i 

IS  S 

CD 

CD 

CD 

CD 

LU 

Z  5 

T“ 

1— 

Q 

o 

'oo' 

"cT 

"oT 

-t— 

Z!3 

h- 

o 

o 

CD 

CO 

CM 

o 

in 

Q. 

in 

00 

O 

1^ 

00 

c 

—  C 

03 

C33 

o 

O 

d 

o 

O 

00 

CD 

o 

CL 

gi 

d 

in 

d 

in 

d 

d 

d 

d 

in 

d 

in 

CO 

<  ^ 
LU 

0 

03 

C33 

o 

o 

o 

o 

CD 

CD 

h- 

^  (0 
Z  «J 

T— 

7 


ECPINS/ATON  1 .71  results  show  some  differences  with  respect  to  the  truth  numbers. 

The  standard  deviation  of  the  range  values  was  0.14  yards,  about  5  inches.  The  difference  is 
attributed  to  the  way  OSL  models  the  area  around  AP.  We  believe  they  use  a  different 
mathematical  approach  versus  the  NGS  spherical  geometry  approach.  When  this  value  is 
included  in  the  positioning  error  budget  it  is  clearly  insignificant.  Throughout  the  ECPINS  1 .7 1 
testing  there  were  some  anomalous  bearing  adjustments  being  performed  by  the  ECPINS  that 
could  not  be  accounted  for  with  the  technical  personnel  at  the  LBSF/C2CEN.  At  the  Alpha  test 
point  the  system  seemed  to  be  adding  1 .969  degrees  to  the  bearing  to  AP  for  values  between  0- 
1 80  and  subtracting  1 .969  for  values  between  1 80-360  degrees.  Alpha  had  the  largest  bias,  but 
the  others  exhibited  biases  of  0.68  (Bravo),  0.18  (Delta)  and  test  point  Charlie  had  no  apparent 
bearing  bias.  These  anomalous  bearing  adjustments  do  not  effect  the  positioning  of  aids  as  the 
range  values  are  the  determining  factor  in  on/off  station  calculations.  In  December  1999,  the 
LBSF/C2CEN  ran  these  same  tests  on  ECPINS/ATON  version  1.73.  The  results,  as  shown  in 
the  spreadsheets,  indicates  that  the  bearing  bias  has  been  eliminated  resulting  in  small  bearing 
errors,  less  than  .01  degree.  With  this  bearing  problem  isolated  and  corrected  ECPINS/ATON 
version  1 .73  yields  bearing  performance  that  is  quite  comparable  to  the  NGS  values. 

Antenna  Offset  data 

AAPS  3.4  and  ATONIS/AAPS  4.0  delivered  error  free  consistent  results  when  performing 
antenna  offsets  on  the  vessel.  ECPINS/ATON  1.71  had  some  slight  differences  from  the  truth 
calculations.  In  all  cases,  however  the  offsets  were  found  to  be  within  about  3  inches.  Again, 
this  difference  is  considered  insignificant  and  will  be  a  small  part  of  the  translation  errors,  which 
are  most  sensitive  to  gyro  compass  errors  of  bias  or  lag  when  heading  is  changing.  While 
performing  the  antenna  offsets  the  ECPINS  still  exhibited  the  anomalous  bearing  bias  at  test 
point  Alpha.  In  this  case  it  again  seemed  to  add  this  bearing  adjustment  to  the  actual  bearing  to 
the  offset  position.  It  did  not  cause  an  error  or  a  problem,  it  just  presents  this  adjusted  bearing 
instead  of  the  actual  bearing  between  the  points.  This  was  resolved  in  ECPINS/ATON  1 .73. 

Excursion  data 

AAPS  3.4  and  ATONIS/AAPS  4.0  delivered  error  free  consistent  results  when  performing 
excursion  calculations  to  account  for  distance  from  the  vessel  to  calculate  the  most  probable 
position.  ECPINS/ATON  version  1.71  was  found  to  be  in  error  due  to  the  anomalous  bearing 
adjustment  being  performed  by  ECPINS.  While  this  anomaly  was  not  a  significant  problem  in 
earlier  tests  it  caused  significant  errors  in  excursion.  In  the  four  excursion  calculations  run,  the 
ECPINS  was  found  to  be  off  by  26-30  inches.  When  we  compensated  our  input  for  the  1 .969 
degree  bias  we  found  the  results  to  be  within  2  inches.  As  this  bearing  problem  has  been 
corrected  in  ECPINS  version  1.73,  the  excursion  function  is  now  working  properly. 

Conclusions 

1 .  We  developed  an  effective  means  for  evaluating  the  positioning  accuracy  of  AtoN 
positioning  systems.  This  was  demonstrated  in  C2Cen’s  ability  to  reproduce  the  test  without 
R&D  Center  assistance. 

2.  An  error  budget  for  determining  the  statistical  significance  of  the  results  of  these  tests  was 
developed  and  should  prove  useful  for  other  AtoN  positioning  issues. 
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3.  AAPS  3.4  and  ATONIS/AAPS  4.0  are  effectively  equivalent  to  the  National  Geodetic 
Survey  algorithms  in  all  test  cases.  The  sole  recommendation  is:  In  order  to  maintain 
consistency  with  AAPS  3.4,  ATONIS/AAPS  4.0  should  have  its  presentation  of  bearing  to 
AP  changed  from  0.1  to  0.01  degrees  resolution  on  the  APR. 

4.  The  ECPINS/ATON  version  1 .71  we  tested  had  a  problem  where  it  introduced  biases  into  the 
bearing  between  positions.  This  was  not  generally  a  problem  except  in  the  excursion 
function  where  it  caused  significant  errors.  Later  testing  of  ECPINS/ATON  version  1 .73  by 
LBSF/C2CEN  shows  that  this  bearing  bias  has  been  corrected  and  that  ECPINS/ATON  now 
produces  acceptable  results. 

5.  The  end  result  of  this  testing  is  that  AAPS  3.4.  ATONIS/AAPS  4.0  and  ECPINS/ATON  1 .73 
can  be  used  interchangeably  for  positioning  aids  to  navigation  and  achieve  equivalent 
operational  results. 


